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EXECUTIVE  SUMMARY 


The  rapid  rise  in  unmanned  aerial  vehicle  (UAV)  employment  has  been  accompanied  by 
increased  attention  to  their  high  mishap  rates  which  are  several  orders  of  magnitude  greater  than 
manned  aviation.  Such  high  rates  have  negative  implications  for  UAV  affordability  and  mission 
availability  and  are  unacceptable  in  light  of  the  Secretary  of  Defense’s  challenge  to  “reduce  the 
number  of  mishaps  and  accident  rates  by  at  least  50%. ”  A  comprehensive  10-year  review  of 
human  factors  in  Department  of  Defense  (DoD)  UAV  mishaps  was  conducted  using  DoD’s  new 
Human  Factors  Analysis  and  Classification  System  (HFACS).  HFACS  is  a  model  of  accident 
causation  based  on  the  premise  latent  failures  at  the  levels  of  organizational  influences,  unsafe 
supervision,  and  unsafe  preconditions  predispose  to  active  failures  (e.g.,  UAV  operator  error). 

Put  simply,  operator  error  is  the  physical  manifestation  of  pre-existing  latent  failure(s).  The 
HFACS  model  is  useful  because  it  shifts  the  focus  from  operator  error  to  the  latent  failures  which 
facilitated  the  error.  Targeting  these  latent  failures  serves  to  prevent  error  from  recurring  which 
is  a  much  more  effective  approach  to  mishap  prevention  than  simply  reacting  to  specific  acts  by 
operators. 

This  study  found  operations  or  maintenance  human  causal  factors  to  be  present  in  68%  of 
UAV  mishaps.  Human  factors  mishaps  were  most  frequent  in  the  Air  Force  followed  by  the 
Navy/Marines  and  Army.  However,  the  pattern  of  latent  failures  predisposing  UAV  operators  to 
err  differed  markedly  between  the  services,  implying  a  broad,  systematic  approach  to  mitigating 
UAV  mishaps  may  not  be  possible.  For  the  Air  Force,  latent  failures  involved  instrumentation 
and  sensory  feedback  systems,  automation,  and  channelized  attention.  In  contrast,  errors  by 
Army  UAV  operators  were  associated  with  latent  failures  involving  procedural  guidance  and 
publications,  organizational  training  issues  and  programs,  operator  overconfidence,  and  crew 
coordination  and  communication.  Navy/Marine  UAV  mishaps  were  found  to  be  closely 
associated  with  workload  and  attention  and  risk  management  latent  factors.  Although 
electromechanical  malfunctions  were  very  common,  many  were  physical  manifestations  of 
recurring  latent  failures  in  acquisitions  processes.  The  specific  types  of  operator  errors  differed 
between  the  services  with  skill-based  errors  more  common  in  the  Air  Force  and  violations  in  the 
Army.  There  was  no  difference  in  the  frequency  of  decision  errors. 

Based  on  the  empirical  results  of  this  study,  the  following  service-specific 
recommendations  are  made: 

•  Air  Force:  Undertake  a  comprehensive  program  to  evaluate  and  optimize  UAV  operator 
selection  and  training  criteria  and  the  ground  control  station  (GCS)  interface  design. 

•  Army:  Improve  technical  publications,  checklists,  and  initial  operator  training  programs  to 
include  a  specific  curriculum  emphasis  on  crew  resource  management. 

•  Navy/Marines:  Conduct  a  thorough  job  task  analysis  of  UAV  operator  crew  positions  with 
the  goal  of  improving  job  and  workstation  design,  assessing  manpower  requirements,  and 
developing  empirically-based  training  programs  and  formal  procedures  and  guidance. 
Institutionalize  operational  risk  management  (ORM)  at  all  levels  of  UAV  acquisitions  and 
operations. 


vi 


•  DoD-wide:  Refocus  the  investigational  spotlight  from  immediate  mechanical  failures  as  the 
cause  of  UAV  mishaps  to  failures  in  the  organizational  culture,  management,  or  structure  of 
DoD’s  acquisition  processes  for  UAVs. 
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U.S.  MILITARY  UNMANNED  AERIAL  VEHICLE  MISHAPS:  ASSESSMENT  OF  THE 
ROLE  OF  HUMAN  FACTORS  USING  HUMAN  FACTORS  ANALYSIS  AND 
CLASSIFICATION  SYSTEM  (HFACS) 


INTRODUCTION 

A  great  deal  of  effort  has  been  expended  over  the  last  several  decades  to  demonstrate  the 
technical  viability  and  improve  the  operational  utility  of  unmanned  aerial  vehicles  (UAVs),  also 
known  as  remotely  piloted  vehicles  or  aircraft  (RPVs  or  RPAs).  Current  Department  of  Defense 
(DoD)  operational  UAV  systems  have  demonstrated  tremendous  capability  in  recent  military 
operations  with  at  least  100  UAVs  of  10  different  types  utilized  in  U.S.  military  operations  in 
Iraq  (20).  However,  the  rapid  rise  in  UAV  employment  has  been  accompanied  by  increased 
attention  to  their  high  mishap  rates.  For  example,  since  its  inception,  the  Air  Force’s  RQ-1 
Predator  accumulated  a  mishap  rate  of  32  mishaps  per  100,000  flight  hours,  the  Navy/Marine’s 
RQ-2  Pioneer  334  mishaps  per  100,000  hours,  and  the  Army’s  RQ-5  Hunter  55  mishaps  per 
100,000  hours.  When  compared  to  the  mishap  rate  for  general  aviation  of  1  mishap  per  100,000 
flight  hours,  the  magnitude  of  the  problem  becomes  readily  evident.  The  reliability  of  UAVs 
needs  to  improve  by  one  to  two  orders  of  magnitude  to  reach  the  equivalent  level  of  safety  of 
manned  aircraft  (19,20,21).  Despite  the  absence  of  human  suffering  directly  resulting  from  UAV 
mishaps  to  date,  there  are  significant  reasons  to  be  concerned.  As  stated  by  General  Jumper,  the 
Air  Force  Chief  of  Staff  (5): 

We’ve. . .got  to  have  some  respect  for  the  fact  that  because  these  are  UAVs,  they  are  neither 

expendable  or  disposable.  They  cost  a  lot  of  money. 

According  to  two  reports  by  the  Office  of  the  Secretary  of  Defense  (19,21),  “the  reliability  and 
sustainability  of  UAVs  is  vitally  important  because  it  underlies  their  affordability  (an  acquisition 
issue),  their  mission  availability  (an  operations  and  logistics  issue),  and  their  acceptance  into 
civil  airspace  (a  regulatory  issue).”  Likewise,  a  Defense  Science  Board  study  on  UAVs  (20) 
issued  in  February  2004,  identified  “high  mishap  rates”  as  one  of  the  two  biggest  threats  to 
realizing  the  full  potential  of  UAVs. 

The  Office  of  the  Secretary  of  Defense’s  UAV  Reliability  Study  (19)  issued  in  2003  is  the 
most  comprehensive  review  of  UAV  mishaps  to  date,  the  results  of  which  were  extracted  in  large 
part  into  DoD’s  UAV  Roadmap  2002-2007  (21)  and  served  as  the  basis  for  the  Defense  Science 
Board’s  analysis  of  UAV  mishaps  (20).  This  study  found  the  aggregate  sources  of  failures  in  the 
Air  Force’s  RQ-1  Predator,  Navy/Marine’s  RQ-2  Pioneer,  and  Army’s  RQ-5  Hunter  were 
power/propulsion  (37%),  flight  controls  (26%),  communications  (11%),  human  factors  (17%), 
and  miscellaneous  (9%).  It  noted  “the  proportions  of  human  error-induced  mishaps  are  nearly 
reversed  between  UAVs  and  the  aggregate  of  manned  aircraft,  i.e.,  human  error  is  the  primary 
cause  of  roughly  85%  of  manned  mishaps,  but  only  17%  of  unmanned  ones.”  Two  theories  were 
offered  to  explain  this  observation.  First,  human  influence  in  UAVs  is  significantly  reduced 
(e.g.,  “70%  less”)  and  is  countered  by  increased  automation.  Second,  human  error  rates  remain 
constant  between  UAVs  and  manned  aircraft  and  are  simply  overshadowed  by  the  higher 
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unreliability  of  other  subsystems  in  UAVs.  Although  no  breakdown  of  human  factors  was 
provided,  the  study  reported  “three  of  the  areas  (power/propulsion,  flight  control,  and  operator 
training)  have  historically  accounted  for  80  percent  of  UAV  reliability  failures”  and  “overall 
mishap  rates  for  UAVs  could  be  significantly  reduced  by  focusing  reliability  improvement 
efforts  in  these  areas,”  implying  human  error-induced  mishaps  were  related  to  training 
deficiencies.  Additionally,  the  study  suggested  UAV  operator  situational  awareness  may  be 
degraded  by  the  challenges  of  “human-machine  synergy”  when  the  human  is  on  the  ground. 
Recommendations  included  enhance  operator  training,  particularly  through  simulation  in  the 
ground  control  station  (GCS)  environment,  automate  launch  and  recovery  operations,  and 
employ  enhanced  synthetic  vision  technology  to  help  UAV  operators  maintain  flight  and  sensor 
perspective.  The  only  additional  human  factors  identified  in  the  Defense  Science  Board’s  UAV 
study  (20)  were  the  limited  experience  level  of  UAV  operators  and  maintainers,  inadequate 
overall  professional  development  of  UAV  personnel,  and  the  need  to  better  address  takeoff  and 
landing  errors. 

Given  the  limited  scope  of  the  human  factors  analysis  in  DoD’s  UAV  Reliability  Study, 
the  literature  was  reviewed  for  other  studies  addressing,  in  total  or  in  part,  the  role  of  human 
factors  in  UAV  mishaps.  One  of  the  earliest  reviews  of  UAV  mishaps  was  conducted  by 
Schmidt  and  Parker  (25)  with  the  goal  of  determining  if  existing  naval  aviation  safety  program 
human  factors  efforts  could  reduce  naval  UAV  mishap  rates.  They  analyzed  data  from  the  U.S. 
Navy’s  UAV  System  Safety  Working  Group  minutes,  UAV  unit  safety  survey  results,  informal 
UAV  operator  interviews,  and  UAV  mishap  reports.  Problem  areas  identified  from  the  safety 
working  group  minutes,  survey  results,  and  operator  interviews  included  operator  selection  and 
training,  aeromedical  certification  and  readiness  standards,  simulator  support,  crew  coordination, 
and  career  field  development.  Their  review  of  UAV  mishap  reports  included  170  RQ-2  Pioneer 
mishaps  over  the  period  1986-1993.  The  breakdown  of  UAV  mishap  causal  factors  were  25% 
engine  failure,  24%  electrical  failure,  22%  landing  error,  10%  mechanical  failure,  10%  launch 
error,  and  9%  miscellaneous  to  include  defective  visual  acuity,  personnel  illness,  low 
proficiency,  spatial  disorientation,  poor  crew  coordination,  and  crew  station  design.  They 
reported  over  50%  of  mishaps  had  human  factor  elements,  such  as  proficiency  and  currency 
issues  contributing  to  launch  and  landing  errors  and  failures  or  delays  in  recognizing  and 
correctly  responding  to  mechanical  failures.  Based  on  these  findings,  they  recommended  the 
naval  UAV  safety  program  focus  on  aeromedical  screening  and  monitoring  guidelines,  criteria 
based  selection  procedures  and  tests,  crew  coordination  and  tailored  aviation  physiology  training 
programs,  enhanced  human-systems  integration  in  crew  station  design,  and  UAV  community 
career  field  development.  They  also  recommended  a  more  comprehensive  human  factors 
analysis  be  conducted  and  a  subsequent  database  constructed. 

Seagle  (27)  attempted  a  more  systematic  analysis  of  the  role  of  human  factors  in  naval 
UAV  mishaps  using  Shappell  and  Wiegmann’s  Taxonomy  of  Unsafe  Operations  (28)  which 
describes  3  levels  of  human  causal  factors  (e.g.,  unsafe  supervisory  practices,  unsafe  conditions 
of  operators,  and  the  unsafe  actions  operators  commit)  that  are  expanded  into  17  categories. 
Seagle  reviewed  203  RQ-2  Pioneer  mishaps  occurring  during  the  period  of  fiscal  years  1986- 
1997  and  found  103  (50.7%)  mishaps  had  human  causal  factors  and  88  (43.3%)  mishaps  were 
specifically  associated  with  supervisory  and  aircrew  causal  factors.  Of  these  88  mishaps,  64.1% 
involved  unsafe  supervision  of  which  known  unsafe  supervisory  conditions  such  as  inadequate 
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supervision  (e.g.,  training,  policies,  and  leadership)  and  failure  to  correct  known  problems 
accounted  for  the  largest  categories.  Forty-six  percent  involved  unsafe  conditions  of  operators, 
mostly  aeromedical  conditions  and  crew  resource  management  (CRM)  deficiencies.  Fifty-nine 
percent  had  unsafe  acts  with  mistakes  the  most  common  category.  Seagle  also  noted  human 
causal  factors  varied  based  on  environmental  conditions,  service,  and  phase  of  flight.  Unsafe 
conditions,  particularly  aeromedical  conditions  and  CRM  failures,  were  more  common  during 
embarked  versus  ashore  operations.  Known  unsafe  supervisory  conditions  and  CRM  failures 
were  associated  more  with  Navy  than  Marine  Corps  mishaps.  The  landing  phase  accounted  for 
48.9%  of  the  human  related  mishaps  with  CRM  failures  and  mistakes  the  most  common  factors. 
Seagle  advised  unsafe  supervisory  practices  be  addressed  through  improved  leadership  training 
and  involvement,  by  ensuring  a  better  understanding  of  existing  procedures,  and  implementing 
procedures  where  none  currently  exist.  Unsafe  conditions  of  operators  should  be  addressed 
through  improved  aeromedical  standards  and  a  CRM  training  program  and  the  frequency  of 
mistakes  reduced  by  the  acquisition  of  a  flight  simulator  and  improved  training  programs.  He 
also  discussed  the  need  for  UAV  community  career  field  development. 

Ferguson  (13)  took  the  systematic  analysis  of  naval  UAV  mishaps  a  step  further  by 
developing  a  stochastic  model  simulation  for  the  evaluation  of  human  factors  initiatives  in  terms 
of  budgetary  cost  and  mission  readiness.  In  creating  the  stochastic  model,  he  constructed  a 
mishap  database  using  the  Taxonomy  of  Unsafe  Operations  (28).  He  reviewed  228  RQ-2 
Pioneer  mishaps  occurring  during  the  period  of  fiscal  years  1986-1998,  but  limited  his  analysis 
of  causal  factors  to  the  period  of  fiscal  years  1993-1998  when  mishap  reports  were  standardized 
by  the  Navy’s  aviation  safety  program.  During  the  latter  period,  there  were  93  mishaps  of  which 
55  (59.1%)  had  human  causal  factors.  Of  these  55  mishaps,  72.7%  involved  unsafe  supervision, 
67.3%  unsafe  conditions  of  operators,  and  63.6%  unsafe  acts.  In  contrast  to  Seagle’ s  findings, 
unforeseen  unsafe  supervisory  conditions  were  more  common  than  known  unsafe  supervisory 
conditions  and  aircrew  attentional  errors  (e.g.,  slips)  were  more  common  than  mistakes.  At  the 
unsafe  aircrew  conditions  level,  CRM  was  still  the  most  significant  category.  Based  on  his 
simulation  model,  human  causal  factor  mishaps  significantly  reduced  mission  readiness  and  were 
as  costly  as  electromechanical  mishaps.  Surprisingly,  engineering  modifications  (e.g.,  engine 
improvement/replacement)  were  predicted  to  have  only  a  marginal  effect  on  mission  readiness 
and  cost.  He  concluded  human  factors  should  be  the  primary  target  of  intervention  strategies  and 
recommended  the  use  of  simulators,  implementation  of  improved  CRM  training,  and 
stabilization  of  the  UAV  career  field. 

Manning  et  al  (16)  investigated  the  role  of  human  causal  factors  in  Army  UAV  mishaps 
using  a  refined  version  of  Shappell  and  Wiegmann’s  Taxonomy  of  Unsafe  Operations,  the 
Human  Factors  Analysis  and  Classification  System  (HFACS)  (29),  which  describes  4  levels  of 
human  related  causal  factors  (e.g.,  organizational  influences,  unsafe  supervision,  unsafe 
preconditions,  and  unsafe  acts)  that  are  expanded  into  17  categories.  They  reviewed  56  UAV 
mishaps  occurring  during  the  period  of  fiscal  years  1995-2003  and  identified  18  (32%)  mishaps 
with  human  causal  factors.  Of  these  18  mishaps,  organizational  influences  were  present  in  44% 
and  involved  just  the  category  of  organizational  processes.  Unsafe  supervision  was  involved  in 
half  and  included  the  categories  of  inadequate  supervision  (33%),  failure  to  correct  a  known 
problem  (17%),  and  supervisory  violations  (1 1%).  Preconditions  for  unsafe  acts  were  present  in 
6%,  all  CRM  failures.  Unsafe  acts  were  present  in  61%  of  human  causal  factor  mishaps,  with 


3 


decision  errors  the  most  common  category.  The  authors  concluded  human  error  played  a 
significant  role  in  Army  UAV  accidents  and  the  identification  of  individual  unsafe  acts  as  the 
leading  human  causal  factor  suggested  the  need  for  interventions  targeting  individual  mistakes. 

Rogers  et  al  (23)  conducted  a  review  and  analysis  of  the  human-systems  issues  involved 
in  UAV  mishaps  using  a  human-systems  issues  taxonomy.  They  analyzed  U.S.  Army  and  Air 
Force  UAV  mishaps  occurring  from  January  1993  to  June  2003  and  identified  48  mishaps  (26 
Army  and  22  Air  Force  mishaps),  33  (68.8%)  which  were  caused  by  operational  human-systems 
issues.  The  breakdown  of  human-systems  issues  in  these  33  mishaps  was  27%  training,  25% 
team  performance,  18%  situational  awareness,  16%  interface  design,  and  14%  cognitive  and 
decision  making.  Additionally,  they  examined  mishap  UAV  operator  flight  experience  for  Air 
Force  mishaps  only  and  found  the  highest  frequency  of  mishaps  occurred  among  those  with  the 
least  UAV  experience  (0-500  UAV  flight  hours)  and  the  most  total  flight  experience  (>1,000 
total  flying  hours).  They  concluded  the  UAV  development  community  must  focus  significant 
attention  and  resources  on  human-systems  issues  both  during  design  and  testing.  They 
recommended  the  military  services  pool  their  mishap  experiences,  periodically  analyze  UAV 
mishaps  to  identify  human-systems  issues  using  a  refined  human-systems  issues  taxonomy,  and 
ensure  any  new  insights  are  promptly  provided  to  the  acquisition  community. 

Finally,  Williams  (34)  conducted  a  review  of  DoD  UAV  mishaps  using  a  novel  2-step 
classification  process.  Mishaps  were  first  classified  as  human  factors,  maintenance,  aircraft,  or 
unknown.  Human  factors  were  further  classified  as  alerts/alarms,  display  design,  procedural 
error,  skill-based  error,  or  other.  He  found  the  types  of  mishaps  and  patterns  of  human  factors 
varied  based  on  the  UAV  system.  Overall,  electromechanical  failure  (33-67%)  was  more 
common  than  human  error  (21-68%)  as  a  cause  of  UAV  mishaps.  Human  factors  were  most 
prevalent  in  RQ-1  Predator  mishaps  (67%)  and  consisted  mainly  of  procedural  error  and  display 
design  deficiencies.  Twenty-eight  percent  of  RQ-2  Pioneer  mishaps  and  47%  of  RQ-5  Hunter 
mishaps  were  attributed  to  human  factors,  the  majority  of  which  were  external  pilot  landing 
errors.  In  contrast,  the  RQ-7  Shadow,  which  is  equipped  with  an  automated  landing  system,  had 
human  causal  factors  present  in  21%  of  mishaps.  The  specific  human  factors  issues  in  the  RQ-7 
included  alerts  and  alarms  (40%),  display  design  (40%),  and  procedural  error  (40%). 

Although  Williams  (34)  provides  a  review  of  human  factors  in  UAV  mishaps  in  all  three 
military  services  via  the  UAV  systems  they  operate,  he  doesn’t  utilize  a  standardized  accident 
model  or  human  factors  taxonomy  that  would  allow  for  a  hierarchical  analysis  of  human  error 
(1,28,29,32,33).  The  other  studies  do  not  provide  an  aggregate  DoD-wide  look  at  human  factors 
in  UAV  mishaps,  and  with  the  exception  of  the  studies  by  Seagle  (27)  and  Ferguson  (13)  both 
examining  Navy  UAV  mishaps,  none  utilize  a  similar  human  factors  taxonomy  allowing  the 
direct  comparison  of  findings.  Such  a  comparison  across  military  services  would  be  useful  to 
determine  which  human  factors  are  common  and  likely  inherent  to  all  UAV  operations  versus 
those  which  are  service-specific  and  reflect  outcomes  of  different  policies  and  processes  or  are 
unique  to  UAV  type.  Determining  the  prevalence  of  specific  human  factors  would  also  allow  the 
necessary  prioritization  of  interventions  given  ever  present  resource  limitations  and  identify 
those  interventions  best  initiated  at  the  joint  (e.g.,  DoD)  versus  individual  services  level.  Finally, 
utilization  of  a  hierarchical  model  of  human  error  to  identify  latent  as  well  as  active  human 
failures  would  be  of  importance  since  latent  failures  have  the  tendency  to  contribute  to  more 


4 


mishaps  than  active  failures  (1,32,33).  Therefore,  the  purpose  of  this  study  is  to  provide  a 
quantitative  analysis  of  the  role  and  patterns  of  active  and  latent  human  failures  in  UAV  mishaps 
within  the  U.S.  military  services  using  a  standardized  human  factors  taxonomy  (1). 


TABLE  1.  Summary  of  prior  UAV  mishap  studies. 


Schmidt  &  Parker  (25) 

Seagle  (27) 

Ferguson  (13) 

Manning  et  al.  (16) 

Rogers  et  al.  (23) 

Navy 

Navy 

Navy 

Army 

Air  Force,  Army 

n  =  170 

n  =  203 

n  =  93 

n  =  56 

n  =48 

Taxonomv:  None 

Taxonomv:  Taxonomv  of 

Taxonomy:  Taxonomv  of 

Taxonomy:  HFACS 

Taxonomy:  Human- 

Unsafe  Acts 

Unsafe  Acts 

systems  issues 

Human  Factors:  >50% 
(estimated) 

Human  Factors:  43% 

Human  Factors:  59% 

Human  Factors:  32% 

Human  Factors:  69% 

Factors: 

Factors:* 

Factors:* 

Factors:* 

Factors: 

Aeromedical  screening 

Unsafe  acts  (59%) 

Unsafe  acts  (38%) 

Unsafe  acts  (61  %) 

Training  (27%) 

Selection  procedures 

Accidental  acts  (52%) 

Intended  (17%) 

Skill-based  (22%) 

Team  performance  (25%) 

CRM 

Slips  (2%) 

Mistakes  (12%) 

Decision  (33%) 

Situational  awareness  (18%) 

Crew  station  design 

Lapses  (16%) 

Violations  (7%) 

Misperception  (17%) 

Interface  design  (16%) 

Career  field  development 

Mistakes  (39%) 

Unintended  (20%) 

Violations  (11%) 

Cognitive  &  decision 

Conscious  acts  (7%) 

Slip  (14%) 

Preconditions  (6%) 

making  (14%) 

Infractions  (7%) 

Lapse  (3%) 

CRM  (6%) 

Unsafe  condition  (46%) 

Unsafe  condition  (40%) 

Unsafe  supervision  (50%) 

Aeromedical  (20%) 

Aeromedical  (10%) 

Inadequate  supervision  (33%) 

CRM  (27%) 

CRM  (28%) 

Failed  to  correct  known 

Readiness  violations  (7%) 

Readiness  violations  (10%) 

problem  (17%) 

Unsafe  supervision  (61  %) 

Unsafe  supervision  (43%) 

Supervisory  violations  (11%) 

* 

Unforeseen  (34%) 

Unforeseen  (15%) 

Organizational  influences  (44%) 

Foreseen  (47%) 

Foreseen  (12%) 

Organizational  processes  (44%) 

*  Percents  based  on  number  of  human  factor  mishaps. 


METHODS 
Study  Design 

This  study  protocol  was  approved  by  the  Brooks  City-Base  Institutional  Review  Board  in 
accordance  with  32  CFR  219  and  AFI 40-402.  The  study  design  is  a  10-year  cross  sectional 
quantitative  analysis  of  UAV  mishaps  using  DoD  HFACS  (1)  version  5.7f  taxonomy  with 
associated  nanocodes  (Wurmstein  A,  USAF  Safety  Center.  Personal  communication;  2004). 

DoD  HFACS  taxonomy  is  based  on  Weigmann  and  Shappell’s  HFACS  and  the  reader  is  referred 
to  their  work  for  a  more  detailed  description  of  the  taxonomy  system  (29,33).  In  brief,  HFACS 
describes  four  levels  of  latent  and  active  human  failure:  1)  organizational  influences,  2)  unsafe 
supervisory  practices,  3)  unsafe  preconditions  of  operators,  and  4)  acts  committed  by  operators. 


f  Version  6.2  is  the  final,  approved  iteration  of  DoD  HFACS.  DoD  HFACS  version  5.7  was  the  most  current 
iteration  at  the  time  of  data  collection  for  this  study.  The  main  difference  from  version  5.7  to  6.2  involved  additions, 
deletions,  and  rewording  of  nanocodes,  the  end  result  of  which  was  to  increase  the  total  number  of  nanocodes  from 
138  to  147.  At  the  level  of  root  categories,  “crew  resource  management”  was  changed  to 

“coordination/communication/planning  factors”  and  “misperception  errors”  was  changed  to  “perception  errors.”  For 
the  purposes  of  this  study,  changes  were  significant  only  with  regards  to  the  crew  resource  management  nanocodes. 
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These  four  levels  are  further  resolved  into  root  level  categories  (Appendix  B).  The  purpose  of 
looking  at  all  four  levels  is  to  overcome  the  limitations  of  many  accident  models  which  isolate 
one  factor  as  causal  and  the  others  as  contributory  when  in  fact  most  mishaps  involve  a  variety  of 
events  and  conditions.  In  their  work  to  adopt  HFACS  as  the  standard  DoD  human  factors 
taxonomy,  the  services’  safety  centers  found  there  was  insufficient  resolution  at  the  level  of 
Weigmann  and  Shappell’s  root  categories  to  capture  some  of  the  detail  contained  in  the  service- 
specific  human  factors  taxonomy  systems.  To  remedy  this  problem,  they  developed  a  system  of 
nanocodes,  in  essence  adding  subcategories  to  Weigmann  and  Shappell’s  root  categories  (1). 


Data 

The  inclusion  criteria  for  this  study  were  a  U.S.  Air  Force,  Army,  or  Navy/Marine  UAV 
Class  A,  B,  or  C  severity  mishap  occurring  during  fiscal  years  1994-2003.  Department  of 
Defense  Instruction  6055.7  (8)  definitions  were  utilized.  Thus,  a  UAV  was  defined  as  an 
unmanned  weight-carrying  device  supported  in  flight  by  buoyancy  or  dynamic  action.  A  Class 
A  severity  mishap  was  one  in  which  the  total  cost  of  property  damage  was  $1  million  or  more;  a 
DoD  aircraft  was  destroyed;  or  an  injury  and/or  occupational  illness  resulted  in  a  fatality  or 
permanent  total  disability.  Of  note,  destruction  of  a  UAV  did  not  by  itself  constitute  a  Class  A 
severity  mishap  unless  the  total  costs  were  at  least  $1  million.  A  Class  B  severity  mishap 
resulted  in  total  property  damage  of  $200,000  or  more,  but  less  than  $1  million;  an  injury  and/or 
occupational  illness  resulted  in  permanent  partial  disability;  or  three  or  more  personnel  were 
hospitalized  for  inpatient  care.  A  Class  C  severity  mishap  resulted  in  total  property  damage  of 
$20,000  or  more,  but  less  than  $200,000;  a  nonfatal  injury  caused  loss  of  time  from  work  beyond 
the  day  or  shift  on  which  it  occurred;  or  a  nonfatal  occupational  illness  or  disability  caused  loss 
of  time  from  work  or  disability  at  any  time. 

Site  visits  were  conducted  to  the  respective  safety  centers  for  the  U.S.  Air  Force,  Army, 
and  Navy/Marines  to  access  all  available  mishap  records  and  databases  pertaining  to  UAV 
mishaps.  In  total,  271  mishaps  were  extracted  for  analysis.  However,  per  OPNAVINST 
3750.6R  (9),  the  Navy  specifically  excludes  “unmanned  target  drone  aircraft”  from  the  definition 
of  UAVs  in  their  aviation  safety  program.  To  reduce  the  heterogeneity  of  the  data  between  the 
services,  all  mishap  reports  pertaining  to  unmanned  target  drones  were  censored  from  the  study. 
This  left  221  UAV  mishaps  which  were  submitted  to  further  analyses  using  DoD’s  HFACS 
taxonomy. 


Human  Factors  Classification  using  HFACS 

Two  separate  raters  (one  aerospace  medicine  specialist  and  one  research  physiologist) 
analyzed  each  accident  independently  and  classified  each  human  causal  factor  using  DoD’s 
HFACS  version  5.7  framework  with  associated  nanocodes.  After  the  raters  made  their  initial 
classification  of  the  human  causal  factors,  the  2  independent  ratings  were  compared.  Where 
disagreement  existed,  the  raters  reconciled  their  differences  and  the  consensus  classification  was 
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included  in  the  study  database  for  further  analysis.  A  single  mishap  typically  had  several  human 
factors  associated  with  it,  and  this  analysis  went  beyond  the  primary  causal  factor  and  addressed 
known  contributing  factors.  Mishap  coding  was  done  to  the  lowest  possible  level  given  the  data 
available.  Only  those  causes  and  contributing  factors  identified  by  the  original  investigation 
were  included.  No  new  casual  factors  were  identified  or  accidents  reinvestigated.  However,  in 
cases  where  an  inference  could  reasonably  be  made  as  to  embedded  human  causal  factors  based 
on  the  mishap  narrative,  findings,  or  recommendations,  codes  were  assigned  accordingly.  It  is 
important  to  note  there  was  significant  heterogeneity  in  the  amount  of  detail  contained  within 
mishap  reports.  In  particular,  Army  UAV  mishaps  were  investigated  as  ground  mishaps  until 
October  1,  2003  (10),  and  as  a  result  many  of  the  mishap  reports  were  incomplete  and  pointed  to 
only  one  causal  factor. 

Several  caveats  should  be  highlighted  regarding  the  coding  of  mishaps  involving 
mechanical  failures.  Mishaps  that  were  purely  mechanical  in  nature  without  other  human 
involvement  were  not  coded  using  HFACS  (e.g.,  the  mishap  finding  was  “propulsion  failure”). 
However,  mechanical  failure  did  not  preclude  a  mishap  from  having  human  causal  factors.  For 
example,  a  mishap  involving  mechanical  failure  but  the  UAV  was  recoverable  save  for  the 
delayed  or  improper  actions  of  the  crew  (e.g.,  engine  failure  within  gliding  distance  of  the 
runway)  was  coded  as  human  error-related.  In  such  cases,  mechanical  failures  created  abnormal 
conditions  or  emergencies  which  fostered  human  errors.  Other  mechanical  failures  were  actual 
manifestations  of  latent  failures  at  the  organizational  level  and  were  coded  using  HFACS. 
Examples  include  mishaps  where  it  was  noted  that  a  defect  in  design  was  known  prior  to  the 
flight,  but  was  not  corrected  because  of  demands  of  limited  budgets  or  other  management  or 
policy  constraints.  Many  mechanical  failures  involved  human  error  on  the  part  of  maintenance 
crews.  Although  these  errors  were  coded  using  HFACS,  they  were  not  included  in  the 
subsequent  analysis  of  human  causal  factors  with  the  exception  of  the  initial  determination  of  the 
crude  proportion  of  UAV  mishaps  involving  any  human  factors. 


Statistical  Analysis 

A  database  was  constructed  using  EXCEL  (Microsoft,  Redmond,  WA)  and  each  mishap 
was  assigned  an  identification  number  and  entered  into  a  master  table  regardless  of  causal 
factors.  The  data  set  was  partitioned  to  show  all  four  levels  of  human  factors  distribution  in 
relation  to  1)  all  UAV  mishaps,  2)  mishaps  and  service,  and  3)  mishaps  and  vehicle.  Statistica’s 
(StatSoft,  Tulsa,  OK)  log-linear  analysis  and  Statistical  Package  for  the  Social  Sciences’  (SPSS 
Inc,  Chicago,  EL)  chi-square  (y?),  Cramer’s  V,  Fisher’s  Exact  Test  (FET),  bivariate  correlation, 
and  binary  logistic  regression  were  utilized  (24). 


RESULTS 

Of  the  221  UAV  Class  A,  Class  B,  and  Class  C  mishaps  occurring  during  the  period  of 
fiscal  years  1994-2003,  38  (17.2%)  involved  the  RQ-1  Predator,  127  (57.5%)  the  RQ-2  Pioneer, 
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4  (1.8%)  the  RQ-4  Global  Hawk,  25  (11.3%)  the  RQ-5  Hunter,  20  (9.0%)  the  RQ-7  Shadow,  and 
7  (3.2%)  miscellaneous  or  unspecified  UAVs.  Overall,  151  (68.3%)  mishaps  involved 
operations  or  maintenance  organizational,  supervisory,  or  individual  human  causal  factors. 
Excluding  18  mishaps  solely  caused  by  maintenance  error  which  were  not  analyzed  further,  133 
(60.2%)  mishaps  involved  operations  human  causal  factors,  here  forthwith  referred  to  simply  as 
human  causal  factors.  The  frequency  distribution  of  human  causal  factors  mishaps  within  the 
services  differed  significantly  (x22di  =  15.974,  P  <  0.001)  with  79.1%  in  the  Air  Force,  39.2%  in 
the  Army,  and  62.2%  in  the  Navy/Marines.  Mechanical  failure  was  present  in  150  (67.9%) 
mishaps,  although  it  was  the  sole  causal  factor  in  only  70  (31.7%)  mishaps.  In  contrast,  human 
causal  factors  were  solely  involved  in  53  (24.0%)  mishaps  and  80  (36.2%)  mishaps  were 
attributed  to  the  combination  of  mechanical  and  human  causal  factors  (FET,  P  =  0.003).  No 
cause  was  identified  in  18  (8.1%)  mishaps. 

The  data  set  of  UAV  mishaps  was  partitioned  to  distinguish  between  the  services  and 
human  causal  factors  distributions  in  HFACS  (Appendix  C),  the  top-level  results  of  which  are 
summarized  in  figure  1.  Since  HFACS  is  a  hierarchical  model  based  on  the  premise  latent 
failures  at  the  levels  of  organizational  influences,  unsafe  supervision,  and  unsafe  preconditions 
predispose  to  active  failures  (e.g.,  acts),  the  dependent  variable  in  this  analysis  was  acts.  Latent 
failures  at  the  levels  of  organizational  influences,  unsafe  supervision,  and  unsafe  preconditions 
were  the  independent  variables.  Human  causal  factors  mishaps  were  explored  to  verify  the 
presence  of  independent  variables  was  associated  with  the  occurrence  of  an  act.  This  was  indeed 
the  case  for  the  independent  variables  unsafe  supervision  and  unsafe  preconditions.  However,  47 
(44.8%)  human  causal  factors  mishaps  involving  organizational  influences  did  not  have  an 
associated  act. 


Organizational  Unsafe  Supervision  Unsafe  Acts 

Influences  Preconditions 

Figure  1.  Top  level  HFACS  human  causal  factors  by  military  service  as 
percentage  of  total  mishaps. 
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The  relationship  of  organizational  influences  and  acts  was  further  evaluated  to  explain  the 
apparent  deviation  from  the  underlying  assumptions  of  the  HFACS  model  of  error. 
Organizational  influences  is  composed  of  3  root  categories,  resource/acquisition  management, 
organizational  culture,  and  organizational  processes.  For  the  Air  Force  and  Navy/Marines, 
organizational  influences  was  the  most  frequent  type  of  latent  failure  and  was  present  in  79.4% 
and  82.3%  of  human  causal  factors  mishaps  respectively.  The  services  differed  significantly  in 
the  frequency  distribution  of  mishaps  involving  organizational  influences  (P  =  0.002),  which  was 
largely  attributable  to  the  frequency  distribution  of  mishaps  involving  the  resource/acquisition 
management  root  category  (P  <  0.001).  As  figure  2  illustrates,  the  frequency  distribution  in  the 
resource/acquisition  management  root  category  was  nearly  entirely  the  result  of  the  frequency 
distribution  of  the  acquisition  policies/processes  nanocode.  This  nanocode  predominated  in  Air 
Force  (46.5%)  and  Navy/Marine  (38.6%)  versus  Army  (11.8%)  mishaps.  Mishaps  involving  the 
resource/acquisition  management  root  category  had  a  significantly  higher  likelihood  of  being 
associated  with  an  electromechanical  malfunction  (OR  3.2, 95%  Cl  1. 5-6.6)  rather  than  an  act 
(OR  0.2,  95%  Cl  0.1-0.4)  as  the  active  failure. 

Because  of  concerns  about  potential  latent  failure  detection  biases  caused  by  differences 
in  individual  service  mishap  investigation  methodologies,  the  mishap  database  was  stratified  by 
service.  Service-specific  binary  logistic  regression  models  were  then  computed  using  the  16  root 
categories  of  latent  failure  as  potential  predictor  variables  for  the  dichotomous  dependent 
variable  acts.  Models  were  estimated  using  a  forward  stepwise  method  with  a  classification 
cutoff  value  of  0.500.  The  results  are  summarized  in  table  2.  The  service-specific  logistic 
regression  models  differed  substantially  with  regards  to  the  root  categories  of  latent  error 
retained  in  each  model.  No  single  root  category  of  latent  error  was  present  in  all  three  models. 
Based  on  the  percentage  of  acts  correctly  classified  by  each  service’s  model,  good  models  were 
computed  for  the  Army  and  Navy/Marine  mishap  data  while  only  a  fair  model  could  be 
computed  for  the  Air  Force  mishap  data.  The  breakdown  of  nanocodes  associated  with  each  of 
the  root  categories  of  latent  error  included  in  the  services’  models  are  presented  in  table  3. 

Given  the  complexity  of  the  initial  Navy/Marines  logistic  regression  model  which 
contained  7  predictor  variables,  a  factor  analysis  was  conducted  to  evaluate  for  redundancy 
among  the  predictor  variables.  Specifically,  a  principle  component  analysis  was  utilized  yielding 
2  factors.  Table  4  summarizes  the  results  of  the  factor  analysis.  The  first  factor,  which  was 
labeled  “work  and  attention,”  encompasses  organizational  issues  regarding  the  characteristics 
and  conditions  of  work  (ops  tempo)  and  the  procedures  for  doing  work  (training  and  formal 
procedures),  the  tools  for  conducting  work  (technological  environment),  and  the  operators 
allocation  of  attention  in  conducting  work  (cognitive  attentional  spotlight  and  motivation  to 
attend  to  tasks).  The  second  factor,  labeled  “risk  management,”  includes  situations  where 
squadron  supervision  failed  to  adequately  identify,  recognize,  assess,  or  control  and  mitigate 
risks  through  guidance,  training,  or  oversight,  often  manifest  as  operations  in  physical 
environments  that  exceeded  the  capabilities  of  mishap  UAV  operators. 
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Figure  2.  Contribution  of  resource/acquisition  management  root  category  and  acquisition 
policies/processes  nanocode  to  the  overall  frequency  of  organizational  influences 
causal  factors  by  military  service  as  percentage  of  total  mishaps. 


TABLE  2.  Binary  logistic  regression  models  by  service. 


Model  Variables 

Significance 

(P) 

Percentage  of  acts 
estimated  correctly 

Air  Force 

Technological  Environment 

0.001 

70.8% 

Cognitive  Factors 

0.009 

Army 

Organizational  Processes 

Psycho-Behavioral  Factors 

<0.001 

93.8% 

Crew  Resource  Management 

<0.001 

Navy/Marines 

Organizational  Processes 

Inadequate  Supervision 

<0.001 

Planned  Inappropriate  Operations 

0.010 

93.2% 

Physical  Environment 

0.010 

Technological  Environment 

0.021 

Cognitive  Factors 

<0.001 

Psycho-Behavioral  Factors 

0.005 
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Having  determined  the  independent  variables  most  closely  associated  with  acts  based  on 
service,  the  nature  of  the  acts  by  service  was  analyzed  next.  Figure  3  summarizes  the  root 
categories  of  acts  (e.g.,  skill-based  error,  judgment  and  decision-making  error,  misperception 
error,  and  violations)  as  a  percentage  of  the  total  acts  by  service.  The  services  differed 
significantly  with  regards  to  the  frequency  distribution  of  acts  involving  skill-based  errors 
(Cramer’s  V  =  0.246,  P  =  0.001)  and  violations  (Cramer’s  V  =  0.193,  P  =  0.016).  The  Air  Force 
had  the  highest  frequency  of  skill-based  errors  (47.2%),  followed  by  the  Navy/Marines  (33.3%) 
and  Army  (23.1%).  Of  these  skill-based  errors,  the  procedural  error  nanocode  was  more 
frequent  in  the  Air  Force  and  Navy/Marines  while  the  breakdown  in  visual  scan  nanocode 
predominated  in  the  Army.  The  frequency  distribution  of  acts  involving  violations  was  greatest 
for  the  Army  (34.6%)  as  compared  to  the  Air  Force  (8.3%)  and  Navy/Marines  (9.5%).  There 
was  no  significant  difference  between  the  services  in  the  frequency  distribution  of  acts  involving 
judgment  and  decision-making  errors  or  misperception  errors. 

The  data  set  of  Army  UAV  mishaps  was  partitioned  to  distinguish  between  vehicle  type 
and  human  causal  factors  distributions.  Air  Force  and  Navy/Marine  mishaps  were  excluded 
from  this  dataset  since  they  operate  only  1  UAV  system  in  large  numbers  (e.g.,  the  USAF  RQ-4 
was  excluded  because  there  were  only  5  in  the  inventory  (20))  and  it  would  not  be  possible  to 
distinguish  an  association  between  service  versus  vehicle  type  and  the  human  causal  factors 
distributions.  Specifically,  the  Army’s  RQ-5  Hunter  was  compared  to  the  more  automated  (e.g., 
equipped  with  automatic  landing  system)  RQ-7  Shadow.  There  was  no  significant  difference  in 
the  overall  frequency  distribution  of  human  causal  factors  mishaps.  The  only  significant 
difference  (FET,  P  =  0.030)  was  in  the  frequency  distribution  of  acts  involving  judgment  and 
decision-making  errors  which  was  lower  for  the  RQ-7  (5.0  %)  than  the  RQ-5  (32.0%).  There 
were  no  significant  differences  in  the  frequency  distribution  of  acts  involving  skill-based  errors, 
misperception  errors,  or  violations. 
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TABLE  3.  Root  categories  of  latent  error  and  associated  nanocodes  by  service  model. 


Model  Variables 

Associated  Nanocodes* 

Human-Factors 

Mishaps* 

Air  Force 

79.1% 

Technological  Environment 

47.1% 

Automation 

29.4% 

Instrumentation  &  Sensory  Feedback  Systems 

26.5% 

Cognitive  Factors 

26.5% 

Channelized  Attention 

14.7% 

Army 

39.2% 

Organizational  Processes 

45.0% 

Procedural  Guidance/Publications 

30.0% 

Organizational  Training  Issues/Programs 

20.0% 

Psycho-Behavioral  Factors 

30.0% 

Overconfidence 

25.0% 

Crew  Resource  Management 

35.0% 

Crew  Coordination 

20.0% 

Communication 

10.0%> 

Navy /Marines 

62.2% 

Organizational  Processes 

34.2% 

Procedural  Guidance/Publications 

25.3% 

Organizational  Training  Issues/Programs 

12.7%) 

Risk  Assessment  -  Strategic 

6.3%> 

Ops  Tempo/Workload 

5.1% 

Inadequate  Supervision 

24.1% 

Supervision  -  Policy 

11.4% 

Local  Training  Issues/Programs 

10.1% 

Leadership/Supervision/Oversight  Inadequate 

6.3% 

Planned  Inappropriate  Operations 

11.4% 

Proficiency 

7.6% 

Ordered/Led  on  Mission  Beyond  Capability 

2.5% 

Physical  Environment 

10.1% 

Vision  Restricted  by  Weather/Haze/Darkness 

7.6%) 

Technological  Environment 

10.1% 

Controls  &  Switches 

3.8% 

Automation 

2.5% 

Communications  -  Equipment 

2.5% 

Cognitive  Factors 

19.0% 

Channelized  Attention 

8.9% 

Cognitive  Task  Oversaturation 

5.1% 

Distraction 

5.1% 

Inattention 

3.8%) 

Psycho-Behavioral  Factors 

13.9% 

Complacency 

11.4% 

fNanocodes  with  an  absolute  frequency  <  2  were  excluded  from  the  table. 

*  More  than  one  nanocode  may  have  been  identified  per  mishap,  so  reported  model  variable  frequencies  may  not  be 


simple  summations  of  component  nanocode  frequencies. 
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TABLE  4.  Factors  analysis  of  Navy/Marines  regression  model  variables. 


Model  Variables 

Factors 

Organizational  Processes 
Technological  Environment 
Cognitive  Factors 

Psycho-Behavioral  Factors 

Workload  and  Attention 

Inadequate  Supervision 

Planned  Inappropriate  Operations 
Physical  Environment 

Risk  Management 

100% 

90% 

80% 

70% 

60% 

50% 

40% 

30% 

20% 

10% 

0% 

Air  Force  Army  Navy/Marines 


□  Violations 

E  Misperception  Error 

□  Decision -Making  Error 
■  Srill-Based  Error 


Figure  3.  Root  categories  of  acts  as  percentage  of  total  acts  by  service. 


DISCUSSION 

Before  embarking  on  a  discussion  of  this  analysis  of  UAV  mishaps,  it  is  important  to 
highlight  the  significant  limitations  inherent  in  using  mishap  reports  for  data.  As  noted  by  Weiss 
et  al  (32)  in  their  discussion  on  the  analysis  of  causation  in  aerospace  accidents,  filtering  and  bias 
occur  in  mishap  reports  due  to  the  subjective  interpretation  of  events  by  both  the  individuals 
involved  in  the  mishap  and  the  investigators.  The  accident  model  used  by  investigators  also 
imposes  patterns  on  the  mishap  and  influences  the  data  collected  and  the  factors  identified  as 
causative  (e.g.,  detection  bias),  either  narrowing  or  expanding  the  consideration  of  certain 
factors.  Additionally,  there  is  the  trend  towards  oversimplification  when  one  factor  is  chosen  out 
of  many  contributing  factors  and  labeled  causal  despite  all  factors  involved  being  equally 
indispensable  to  the  occurrence  of  the  mishap.  Thus,  mishaps  are  often  attributed  to  operator 
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error  or  equipment  failure  without  recognition  of  the  systemic  factors  that  made  such  errors  or 
failures  inevitable.  These  limitations  were  present  in  this  study  given  each  of  the  military 
services  used  different  accident  models  and  human  factor  taxonomies  in  their  mishap  reports. 

The  Army’s  policy  prior  to  2003  of  investigating  UAV  mishaps  as  ground  instead  of  aviation 
mishaps  (10)  appeared  to  lead  investigators  to  focus  mainly  on  the  last  or  most  conspicuous 
factor  preceding  the  mishap.  The  forms  used  to  investigate  Army  ground  mishaps,  which  often 
involved  “checking  the  most  appropriate  box,”  had  an  inherent  predilection  of  narrowing  the 
factors  considered.  The  authors  believe  these  factors  biased  the  Army’s  UAV  mishap  data  in 
favor  of  factors  at  the  acts,  and  to  a  lesser  extent,  the  unsafe  preconditions  levels.  Finally,  the 
military  services  operate  distinctly  different  UAV  systems  which  cannot  be  discounted  as  a 
confounder  when  examining  differences  between  the  services.  For  example,  Air  Force  UAV 
operators  fly  from  a  vehicle-centric  perspective  (e.g.,  from  within  the  UAV  via  a  nose  camera 
image)  while  Army  and  Navy/Marine  external  pilots  fly  from  an  exocentric  perspective  (e.g., 
observing  the  UAV  from  a  position  aside  the  runway).  Collectively,  these  limitations  led  to  the 
decision  to  stratify  the  statistical  analysis  based  on  military  service,  consequently  limiting  the 
ability  to  directly  compare  the  frequency  distribution  of  latent  failures  between  services. 
However,  since  active  failures  (e.g.,  operator  acts)  are  the  traditional  focus  of  mishap 
investigations,  the  authors  felt  their  identification  in  the  mishap  process  was  not  likely  to  be 
significantly  skewed  by  any  detection  bias  and  thus  were  comparable  across  services. 

Despite  the  tendency  of  mishap  reports  to  focus  mainly  on  the  active  failures  of  operator 
error  or  equipment  malfunctions  immediately  antecedent  to  a  mishap,  a  major  finding  of  this 
study  was  the  predominance  of  latent  failures  relatively  distant  from  the  mishap  at  the 
organizational  level.  Organizational  factors  were  present  in  two-thirds  of  Air  Force  UAV 
mishaps  and  one-half  of  Navy/Marine  mishaps,  mainly  involving  acquisition  policies  and 
processes.  While  organizational  factors  were  only  present  in  one-quarter  of  Army  mishaps,  this 
was  felt  to  be  under-representative  of  the  true  frequency  secondary  to  the  aforementioned 
aberrances  in  the  Army’s  investigative  process  for  UAVs.  There  were  no  studies  with  which  to 
compare  this  finding  since  Seagle  (27)  and  Ferguson  (13)  both  used  the  predecessor  taxonomy  to 
HFACS  (28)  which  lacked  an  organizational  level.  While  some  may  object  to  the  categorization 
of  mechanical  failures  as  human  factors  in  HFACS,  the  taxonomy  correctly  highlighted  the  latent 
failure  underlying  the  majority  of  UAV  mishaps.  While  DoD’s  UAV  Reliability  Study  (19) 
attributed  the  majority  of  UAV  mishaps  to  subsystem  component  reliability  problems  which 
exist  in  all  current  operational  UAV  systems,  the  Defense  Science  Board’s  UAV  study  found 
(20): 

Many  of  these  early  systems  were  not  developed  or  procured  under  classical  5000  series 
acquisition  rules.  As  such,  specifications  on  system  reliability  were  often  absent. .  .[Predator’s] 
propulsion  subsystem  has  caused  the  vast  majority  of  the  system  losses  that  were  not  combat 
losses.  Predator  was  first  procured  in  1995;  there  was  no  system  reliability  specification  levied  at 
that  time  (p.  17). 

Using  HFACS  terminology,  the  Defense  Science  Board  identified  an  organizational  latent  failure 
in  acquisition  policies  and  processes  (e.g.,  the  lack  of  specifications  on  system  component 
reliabilities),  thus  echoing  the  findings  of  the  present  study.  In  short,  the  excessive  numbers  of 
mechanical  failures  analyzed  in  the  UAV  Reliability  Study  (19)  are  physical  manifestations  of  a 
recurring  latent  failure  in  the  acquisitions  process.  To  effectively  address  current  UAV  mishap 
rates  and  safeguard  investments  in  future  UAV  systems,  the  investigational  spotlight  must  move 
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from  mechanical  failures  as  the  cause  of  UAV  mishaps  to  failures  in  the  organizational  culture, 
management,  or  structure  of  DoD’s  acquisition  processes  for  UAVs. 

Another  major  finding  of  this  study  was  the  pattern  of  latent  failures  predisposing  UAV 
operators  to  err  differed  markedly  between  the  services,  implying  a  broad,  systemic  approach  to 
mitigating  UAV  mishaps  may  not  be  possible.  This  adds  credence  to  the  results  of  the  study  by 
Williams  (34)  which  found  the  types  of  mishaps  and  patterns  of  human  factors  varied  based  on 
the  UAV  system.  For  the  Air  Force,  latent  failures  at  the  individual  and  environmental 
preconditions  level  involving  instrumentation/sensory  feedback  systems,  automation,  and 
channelized  attention  were  mostly  strongly  associated  with  operator  error.  In  short,  the  ground 
control  station  (GCS)  environment  and  the  operator  vehicle  interface  do  not  facilitate  Air  Force 
UAV  operators.  A  number  of  studies  have  demonstrated  that  poorly  designed  automation 
degrades  system  performance,  especially  in  multi-task  vigilance  situations  typical  of  the  GCS 
environment  (2,3,18,22).  This  is  a  very  significant  finding  given  the  Air  Force  is  using  the  same 
GCS  and  operator  vehicle  interface  in  the  MQ-9,  its  next  generation  of  the  Predator.  These 
results  are  also  consistent  with  the  findings  of  Rogers  et  al  (23)  and  Williams  (34)  that  display  or 
interface  design  was  a  significant  human  factors  issue  in  Air  Force  UAV  mishaps. 

The  issue  of  instrumentation/sensory  feedback  as  a  factor  in  Air  Force  UAV  mishaps 
raises  several  interesting  points.  Certainly  compared  to  pilots  of  manned  aircraft,  the  UAV 
operator  is  relatively  sensory  deprived,  lacking  peripheral  visual,  auditory,  and  haptic  cueing 
(17).  However,  the  effect  of  this  sensory  deprivation  has  not  been  well  researched.  In  fact,  little 
is  known  where  UAV  operators  direct  their  attentional  focus  and  what  information  they  are 
sampling.  For  instance,  a  study  of  visual  scan  patterns  using  the  Predator  head-up  display 
(HUD)  revealed  nonstandard  instrument  scan  patterns  (30).  Preliminary  work  with  multimodal 
displays  has  had  mixed  to  promising  results  but  still  needs  to  be  further  studied  (6,12,17). 
Interestingly,  NASA  reported  in  a  summary  of  their  UAV  flight  test  experience  (7)  that 
incorporating  a  microphone  in  the  UAV  and  providing  a  sound  downlink  to  replicate  cockpit 
environmental  noise  in  the  GCS  “proved  invaluable  and  potentially  saved  the  UAVs  in  some 
instances.”  Additionally,  they  recommended  “multifunction  switches  be  limited  or  eliminated” 
and  the  “status  of  critical  parameters  should  be  easily  observable.”  However,  the  Predator  GCS 
is  heavily  reliant  on  multifunction  keys  driving  a  hierarchical  system  of  computer  windows. 
Given  sensory  deprivation  is  common  to  all  current  UAV  operations,  it  is  curious 
instrumentation  and  sensory  feedback  was  not  closely  associated  with  operator  error  in  the  other 
military  services.  One  possible  explanation  is  experienced  pilots  (e.g..  Air  Force  UAV 
operators)  are  more  prone  to  note  the  relative  sensory  deprivation  of  UAV  operations  vice  the 
non-flyer  (e.g.,  Army  and  Navy/Marine  UAV  operators)  who  has  not  developed  skill-based  habit 
patterns  in  association  with  the  multiple  sensory  modalities  present  in  the  flight  environment. 
Nevertheless,  the  obvious  recommendation  for  the  Air  Force  is  to  undertake  a  comprehensive 
program  to  evaluate  and  optimize  the  GCS  with  regards  to  basic  human-systems  integration 
principles. 

In  contrast  to  the  Air  Force,  the  errors  of  Army  UAV  operators  were  most  closely 
associated  with  latent  failures  at  the  organizational  influences  and  individual  and  personnel 
preconditions  levels.  The  specific  latent  failures  included  procedural  guidance  and  publications, 
organizational  training  issues  and  programs,  overconfidence,  and  crew  coordination  and 
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communication.  These  findings  agree  with  Manning  et  al  (16)  who  found  organizational 
processes,  which  includes  the  DoD  nanocodes  for  guidance/publications  and  training,  and  crew 
resource  management  to  be  prevalent  latent  failures  in  Army  UAV  mishaps.  However,  this  study 
found  the  unsafe  supervisory  factors  identified  by  Manning  et  al  were  not  strongly  associated 
with  the  occurrence  of  errors.  This  study  also  confirms  the  findings  of  Rogers  et  al  (23)  that 
training,  team  performance,  and  situational  awareness  were  frequent  human-systems  issues  in 
Army  mishaps.  Based  on  this  evidence,  recommendations  to  mitigate  Army  UAV  mishaps 
should  focus  on  improving  technical  publications  and  checklists  and  initial  operator  training 
programs  to  include  a  specific  curriculum  emphasis  on  crew  resource  management.  Utilization 
of  a  UAV  simulation  environment  capable  of  facilitating  team  training,  especially  in  challenging 
off-nominal  situations,  would  be  important  in  both  the  initial  and  recurrent  training  of  Army 
UAV  operators.  Barnes  et  al  (2)  stressed  the  importance  of  the  latter  recommendation  in  their 
evaluation  of  Army  external  pilots,  noting  “with  experience,  the  operator  is  able  to 
devote... attentional  resources  to  future  problems  while  attending  to  the  immediate  perceptual 
and  motor  tasks  in  an  automatic  mode.” 

The  model  for  Navy/Marine  UAV  mishaps  was  the  most  complex,  involving  latent 
failures  at  the  organizational,  supervisory,  and  environmental  and  individual  preconditions 
levels.  This  may  be  a  reflection  of  the  Navy’s  earlier  acceptance  of  HFACS  which  would  be 
expected  to  improve  the  identification  and  documentation  of  latent  failures  in  their  mishap 
reports.  After  factor  analysis,  Navy/Marine  UAV  mishaps  were  found  to  be  closely  associated 
with  workload  and  attention  and  risk  management  latent  factors.  The  workload  and  attention 
factor  included  issues  of  ops  tempo,  formal  training  programs  and  procedures,  workstation 
design,  and  UAV  operator  attentional  focus  and  motivation.  Interventions  for  this  factor  should 
focus  on  a  thorough  job  task  analysis  of  UAV  operator  crew  positions  with  the  goal  of  improving 
job  and  workstation  design,  assessing  manpower  requirements,  and  developing  empirically- 
based  training  programs  and  formal  procedures  and  guidance.  The  risk  management  factor 
included  inadequate  supervisory  oversight  and  policies,  inadequate  supervisory  risk  assessment 
with  regards  to  operator  capabilities  and  mission  demands,  and  operations  in  degraded  visual 
environments  (e.g.,  darkness,  weather,  etc.).  This  factor  is  best  addressed  by  the 
institutionalization  of  operational  risk  management  (ORM)  at  all  levels  of  UAV  acquisitions  and 
operations.  This  is  especially  true  with  regards  to  launch  and  recovery  operations  conducted  in 
environments  with  a  paucity  of  visual  references,  such  as  shipboard  and  night  operations.  With 
the  exception  of  the  absence  of  a  finding  for  the  need  for  aeromedical  screening  guidelines,  the 
results  of  this  study  are  consistent  with  those  of  Schmidt  and  Parker  (25)  who  identified 
proficiency  and  currency  issues  and  crew  station  design  as  significant  human  causal  factors  in 
Navy  UAV  mishaps.  This  study  also  confirms  Seagle’s  (27)  and  Ferguson’s  (13)  findings 
regarding  unsafe  supervisory  practices  which  were  captured  in  our  risk  management  factor. 
However,  this  study  differs  in  that  aeromedical  conditions  and  CRM  failures  were  not  significant 
categories  of  latent  failure. 

Given  prior  concerns  regarding  inadequate  aeromedical  screening  and  monitoring 
guidelines  (4,13,25,27)  and  questions  raised  about  the  suitability  of  assigning  pilots 
aeromedically  disqualified  from  traditional  flying  duties  to  UAV  duties  (Landsman  G,  Nellis 
AFB.  Personal  communication;  2004),  it  is  noteworthy  there  were  very  few  mishaps  involving 
the  adverse  physiological  states  category,  pre-existing  physical  illness/injury/deficit  nanocode,  or 
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the  pre-existing  personality  disorder  and  psychological  disorder  nanocodes.  This  finding  was 
consistent  with  the  recent  study  by  Manning  et  al  (16)  which  did  not  identify  any  Army  mishaps 
attributable  to  physical  or  mental  disease  or  deficits.  Although  there  currently  is  no  uniform 
standard  across  the  military  services  for  the  aeromedical  certification  of  UAV  operators  (31), 
which  has  made  formulating  a  standard  for  the  future  aeromedical  certification  of  UAV  operators 
in  the  National  Airspace  System  (NAS)  somewhat  problematic,  it  suggests  that  the  aggregate  of 
the  current  standards  is  adequate,  at  least  with  regards  to  “selecting  out”  aeromedically  unsound 
individuals  from  UAV  duties.  Whether  current  standards  can  safely  be  made  less  restrictive  or 
whether  they  should  be  augmented  (e.g.,  neuropsychological  testing)  to  “select  in”  those  with 
certain  innate  abilities  that  might  be  associated  with  an  increased  likelihood  of  success  as  a  UAV 
crewmember  (4,11)  has  yet  to  be  thoroughly  evaluated  and  is  beyond  the  scope  of  this  study. 

An  unexpected  finding  of  this  study  was  at  the  level  of  acts,  where  the  Air  Force  had  a 
significantly  higher  proportion  of  mishaps  attributed  to  skill-based  errors.  Skill-based  errors  are 
essentially  errors  in  basic  flight  skills  and  entail  highly  automatized  psychomotor  behaviors  that 
occur  without  significant  thought  (33).  The  majority  of  these  skill-based  errors  were  procedural 
errors  where  the  technique  employed  by  the  operator  unintentionally  set  them  up  for  the  mishap. 
There  are  currently  vast  differences  between  the  services  in  the  selection  and  training  of  UAV 
operators.  The  Air  Force  uses  experienced  pilots  who  already  have  at  least  one  operational  tour 
of  duty  in  another  aircraft.  By  contrast,  the  Army  and  Navy/Marines  use  enlisted  personnel  who 
are  generally  non-pilots  and  are  given  a  UAV  specific  training  program  (4,15,26,31).  Although 
two  Air  Force  studies  (15,26)  have  concluded  that  manned  aircraft  flying  experience  is  necessary 
for  Predator  operators,  the  study  by  Schreiber  et  al  (26)  specifically  found  by  150-200  hours  of 
flight  time,  most  pilots  had  developed  the  skills  necessary  to  learn  basic  maneuvers  and  landing 
in  the  Predator.  Experienced  Air  Force  pilots  selected  for  Predator  duty  did  not  perform 
significantly  better  on  a  simulated  UAV  task  than  some  less  experienced  groups  and  experience 
with  the  T-l  aircraft  (a  business  class  jet)  did  not  transfer  well  to  the  Predator.  There  was  also 
some  evidence  suggesting  experienced  pilots  may  need  to  unlearn  certain  aspects  of  piloting 
such  as  dependence  on  vestibular  and  peripheral  visual  cueing,  especially  during  landings. 
Additionally,  their  study  found  a  small  but  significant  relationship  between  the  number  of 
lifetime  hours  playing  flight  simulation  computer  games  and  landing  performance.  Gopher  et  al 
(14)  also  demonstrated  the  value  of  a  flight  simulation  computer  game,  particularly  with  regards 
to  training  conceptual  skills,  which  the  Israeli  Air  Force  adopted  into  their  training  program.  Per 
this  study’s  dataset,  66.7%  of  Predator  mishaps  involving  skill-based  errors  occurred  during 
landing  and  60.0%  occurred  in  training  operations.  Given  the  current  Predator  flight  simulator 
does  not  accurately  reproduce  the  handling  characteristics  of  the  actual  vehicle  (USAF  Safety 
Center.  Predator  mishap  report;  2004),  recommendations  include  acquiring  a  simulator  with 
high-fidelity  to  vehicle  handling  characteristics  to  increase  operator  proficiency  or  automate  the 
landing  phase  of  flight  to  eliminate  the  need  for  proficiency  in  the  landing  skill  set.  However,  it 
is  worth  noting  the  Army’s  RQ-7  Shadow  has  an  automatic  landing  system  and  has  a  lower 
frequency  of  mishaps  associated  with  decision-making  errors  and  not  skill-based  errors  when 
compared  to  the  RQ-5  Hunter  which  is  landed  by  an  external  pilot. 

An  additional  unexpected  finding  was  the  absence  of  a  difference  between  the  services  in 
the  frequency  of  mishaps  involving  judgment  and  decision-making  errors.  In  short,  experienced 
military  pilot/UAV  operators  made  as  many  bad  decisions  as  enlisted  UAV  operators  without 
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prior  military  flight  training  or  experience.  Also  noteworthy  is  the  fact  this  study  found  no 
difference  between  the  services  in  the  frequency  of  mishaps  involving  crew  resource 
management.  Together  these  findings  contrast  with  the  results  from  a  Predator  operator  focus 
group  summarized  by  Hall  and  Tirre  (15)  where  the  justification  for  not  utilizing  enlisted 
personnel  was  the  need  to  quickly  and  accurately  make  difficult  decisions,  effectively 
communicate  those  decisions  to  superiors  and  subordinates,  and  be  responsible  for  implementing 
those  decisions.  This  also  challenges  the  assumption  officers,  particularly  rated  pilots,  already 
possess  these  skills  and  additional  training  is  not  required  in  their  case.  Obviously  further 
empirical  work  is  needed  to  optimize  policies  regarding  future  UAV  operator  selection  and 
training. 


CONCLUSION 

The  potential  benefits  and  promise  offered  by  UAVs  in  a  multitude  of  applications  have 
captured  the  attention  of  both  the  military  and  commercial  sectors.  It  is  imperative  to  address 
UAV  mishap  rates  now  so  that  their  full  potential  is  realized.  When  technology  changes  rapidly 
or  new  and  radical  designs  are  introduced,  previous  accident  data  may  no  longer  be  valid  (32). 
This  assessment  of  UAV  mishaps  using  a  validated  hierarchical  model  of  human  error  has 
identified  key  recurring  factors  at  the  organizational,  supervisory,  and  preconditions  levels  which 
need  to  be  addressed  in  order  to  make  UAVs  more  viable  in  the  near  and  distant  future.  As  noted 
by  Weeks  (31):  “Because  UAVs  are  just  beginning  to  be  adapted  into  the  U.S.  military,  human 
factors  research  is  needed  not  only  to  help  resolve  the  controversy  over  operator  qualifications 
but  also  to  support  programs  similar  to  those  for  manned  aviation  including  physical  standards, 
simulator  training,  and  crew  coordination  training.”  Rather  than  being  the  solution  to  human 
error,  UAVs  have  instead  opened  a  new  and  critical  chapter  in  aviation  human  factors. 
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APPENDIX  A 

UAV  SYSTEMS  DESCRIPTIONS  (21) 


MQ-1  Predator/General  Atomics/Air  Force 

The  Air  Force  MQ-1  Predator  was  one  of  the  initial  Advanced  Concept  Technology 
Demonstrations  (ACTD)  in  1994  and  transitioned  to  an  Air  Force  program  in  1997.  It  takes  off 
and  lands  conventionally  on  a  runway  and  can  carry  a  maximum  450  lb  payload  for  24+  hours. 
Operationally,  it  is  flown  with  a  gimbaled  electro-optical/infrared  (EO/IR)  sensor  and  a  SAR, 
giving  it  a  day/night,  all-weather  (within  aircraft  limits)  reconnaissance  capability.  It  uses  either 
a  line-of-sight  (C-band)  or  a  beyond-line-of-sight  (Ku-band  Satellite  Communications 
(SATCOM))  data  link  to  relay  color  video  in  real  time  to  commanders.  Since  1995,  Predator  has 
flown  surveillance  missions  over  Iraq,  Bosnia,  Kosovo,  and  Afghanistan.  In  2001,  the  Air  Force 
demonstrated  the  ability  to  employ  Hellfire  missiles  from  the  Predator,  leading  to  its  designation 
being  changed  from  RQ-1  to  MQ-1  to  reflect  its  multi-mission  capability.  The  Air  Force  operates 
12  systems  in  three  Predator  squadrons  and  is  building  toward  a  force  of  25  systems  consisting  of 
a  mix  of  100  MQ-1  and  MQ-9  aircraft.  IOC  is  anticipated  in  2003. 

Weight:  2250  lb 
Length:  28.7  ft 
Wingspan:  48.7  ft 
Payload:  450  lb 
Ceiling:  25,000  ft 
Radius:  400  nm 
Endurance:  24+  hr 

RQ-2  Pioneer/Pioneer  UAVs,  IncJUSMC 

The  Navy/Marine  RQ-2  Pioneer  has  served  with  Navy,  Marine,  and  Army  units, 
deploying  aboard  ship  and  ashore  since  1986.  Initially  deployed  aboard  battleships  to  provide 
gunnery  spotting,  its  mission  evolved  into  reconnaissance  and  surveillance,  primarily  for 
amphibious  forces.  Launched  by  rocket  assist  (shipboard),  by  catapult,  or  from  a  runway,  it 
recovers  into  a  net  (shipboard)  or  with  arresting  gear  after  flying  up  to  5  hours  with  a  75  lb 
payload.  It  currently  flies  with  a  gimbaled  EO/IR  sensor,  relaying  analog  video  in  real  time  via  a 
C-band  line-of-sight  (LOS)  data  link.  Since  1991,  Pioneer  has  flown  reconnaissance  missions 
during  the  Persian  Gulf,  Bosnia,  and  Kosovo  conflicts.  The  Navy  ceased  Pioneer  operations  at 
the  end  of  FY02  and  transferred  their  assets  to  the  Marine  Corps.  The  Marine  Corps  is 
embarking  on  improvements  to  the  Pioneer  to  extend  their  operations  with  it  until  FY09  or  a 
replacement  is  fielded.  Such  an  improved  Pioneer  would  fulfill  the  third  tier  of  the  Marines’ 

UAV  roadmap,  which  calls  for  a  system  to  support  the  Marine  Expeditionary  Force 
(MEF)/division  out  to  a  radius  of  200  km  (108  nm). 
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Weight:  452  lb 
Length:  14  ft 
Wingspan:  17  ft 
Payload:  75  lb 
Ceiling:  15,000  ft 
Radius:  100  nm 
Endurance:  5  hr 

RQ-4  Global  Hawk/Northrop  Grumman/Air  Force 

The  Air  Force  RQ-4  Global  Hawk  is  a  high  altitude,  long  endurance  UAV  designed  to 
provide  wide  area  coverage  of  up  to  40,000  mm  per  day.  It  successfully  completed  its  Military 
Utility  Assessment,  the  final  phase  of  its  ACTE),  in  June  2000,  and  transitioned  into  Engineering 
and  Manufacturing  Development  (EMD)  in  March  2001.  It  takes  off  and  lands  conventionally  on 
a  runway  and  currently  carries  a  1950  lb  payload  for  up  to  32  hours.  Global  Hawk  carries  both  an 
EO/IR  sensor  and  a  SAR  with  moving  target  indicator  (MTI)  capability,  allowing  day/night,  all- 
weather  reconnaissance.  Sensor  data  is  relayed  over  Common  Data  Link  (CDL)  line-of-sight 
(LOS)  (X-band)  and/or  beyond-line-of-sight  (BLOS)  (Ku-band  SATCOM)  data  links  to  its 
Mission  Control  Element  (MCE),  which  distributes  imagery  to  up  to  seven  theater  exploitation 
systems.  Residuals  from  the  ACTD  consisted  of  four  aircraft  and  two  ground  control  stations. 
Two  more  ACTD  advanced  aircraft  will  be  delivered  in  early  FY03  to  support  EMD  and 
contingency  operations.  The  Air  Force  has  budgeted  for  27  production  aircraft  in  FY02-07,  and 
plans  a  total  fleet  of  51.  The  Air  Force  plans  to  add  other  sensor  capabilities  in  a  spiral 
development  process  as  this  fleet  is  procured.  Ground  stations  in  theaters  equipped  with  the 
Common  Imagery  Processor  (CIP)  will  eventually  be  able  to  receive  Global  Hawk  imagery 
directly.  IOC  for  Imagery  Intelligence  (IMINT)-equipped  aircraft  is  expected  to  occur  in  FY06. 

Weight:  26,750  lb 
Length:  44.4  ft 
Wingspan:  116.2  ft 
Payload:  1950  lb 
Ceiling:  65,000  ft 
Radius:  5400  nm 
Endurance:  32  hr 

RQ-5  Himter/TRW;IAI/Army 

The  RQ-5  Hunter  was  originally  a  joint  Army/Navy/Marine  Corps  Short  Range  UAV 
program  that  the  Army  intended  to  meet  division  and  corps  level  requirements.  It  takes  off  and 
lands  (using  arresting  gear)  on  runways  and  can  carry  up  to  200  lb  for  over  1 1  hours.  It  uses  a 
gimbaled  EO/IR  sensor,  relaying  its  video  in  real  time  via  a  second  airborne  Hunter  over  a  C- 
band  line-of-sight  data  link.  Hunter  deployed  to  Macedonia  to  support  NATO  Balkan  operations 
in  1999,  2000,  2001,  and  2002.  Although  full  rate  production  (FRP)  was  canceled  in  1996,  seven 
low  rate  initial  production  (LRIP)  systems  of  eight  aircraft  each  were  acquired,  four  of  which 
remain  in  service:  two  for  training,  doctrine  development,  and  exercise  support,  and  two  for 


23 


contingency  support.  A  competitively  selected  Extended  Range/Multi -Purpose  (ER/MP)  UAV 
system  will  begin  to  replace  it  as  early  as  FY05-06. 


Weight:  1600  lb 
Length:  23  ft 
Wingspan:  29.2  ft 
Payload:  200  lb 
Ceiling:  15,000  ft 
Radius:  144  nm 
Endurance:  11.6  hr 

RQ-7  Shadow  200/AAI/Army 

The  Army  selected  the  RQ-7  Shadow  200  (formerly  Tactical  UAV  (TUAV))  in 
December  1999  to  meet  its  Brigade  level  UAV  requirement  for  support  to  ground  maneuver 
commanders.  Catapulted  from  a  rail,  it  is  recovered  with  the  aid  of  arresting  gear.  It  will  be 
capable  of  remaining  on  station  for  4  hours  at  50  km  (27  nm)  with  a  payload  of  60  lbs.  Its 
gimbaled  EO/IR  sensor  will  relay  video  in  real  time  via  a  C-band  LOS  data  link.  Current  funding 
allows  the  Army  to  procure  39  systems  of  four  aircraft  each  for  the  active  duty  forces  and  2 
systems  of  four  aircraft  each  for  the  reserve  forces.  Approval  for  full  rate  production  (acquisition 
Milestone  C)  and  IOC  occurred  in  September  2002.  The  Army’s  acquisition  objective,  with  the 
inclusion  of  the  Army  Reserve  component,  is  83  total  systems. 

Weight:  327  lb 
Length:  11.2  ft 
Wingspan:  12.8  ft 
Payload:  60  lb 
Ceiling:  15,000  ft 
Radius:  68  nm 
Endurance:  4  hr 
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APPENDIX  B 
DoD  HFACS  DRAFT  v5.7 


Resource/Acquisition 

Management 


Organizational  Climate 


Organizational  Processes 


Inadequate  !  i  Planned  Inappropriate ;  j  Failure  to  Correct  1  Supervisory  Violations 
Supervision  j  Operations  j  j  Known  Problem 


Environmental  Factors 


Condition  of  individuals  t 


Personnel  Factors 


Physical  i 

i  Techr.otogicat 

.  PhyscaWenlal  1  i  Gognl'we  Factors 

Adverse 

■  Psydio-Behaviora! ' 

.  Perceptual  Factors  i 

to  Resource  \ 

Environment 

i  Environment 

| 

i  Limitations 

■  Phystotegcai 
j  State 

Factors  • 

i 

Mangement 

SeJ  reposed  Stress 


Violations 


Ski-Based 

Errors 


Judgement  & 

|  Decision-Making  Errors 


Misperception 

Errors 
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APPENDIX  C 

UAV  MISHAP  NANOCODE  SUMMARY  CHART 


Data  set  of  UAV  mishaps  partitioned  to  distinguish  between  the  military  services  and  human 
causal  factors  distributions  in  HFACS. 


Air  Force 

Army 

Navy/Marines 

Homan-  Factor 

Total 

Human-Factor 

Total 

Human-Factor 

Total 

Mishaps' 

Mishapst 

Mishaps' 

Mishapst 

Mishaps' 

Mishapsf 

DoD  HFACS  categories  (v5.7) 

Mishaps 

(d°J4) 

(n«43) 

Mishaps 

(n“20) 

(o-51) 

Mishaps 

(r»»79) 

(n-127) 

©!S«ri*Mipnai:!Bflu8iK!M  .  _ 

-'W", 

62.8% 

.  13  ■ 

65.0% 

25.5% 

65 

51.2% 

Resource/Acquisition  Management 

21 

61.8% 

48.8% 

7 

35.0% 

13.7% 

53 

67.1% 

41.7% 

Air  Traffic  Control  Resources 

1 

2.9% 

23% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Airfield  Resources 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

2 

2.5% 

1.6% 

Acquisition  Policies/Processes 

20 

58.8% 

46.5% 

6 

30.0% 

11.8% 

49 

62.0% 

38.6% 

Accession/Selection  Policies 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Personnel  Resources 

0 

0.0% 

0.0% 

1 

5.0% 

2.0% 

3 

3.8% 

2.4% 

Organizational  Climate 

3 

8.8% 

7.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Unit/Oiganizational  Values/Culture 

3 

8.8% 

7.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Organizational  Processes 

18 

52.9% 

41.9% 

9 

45.0% 

17.6% 

27 

342% 

21.3% 

Ops  Tempo/Workload 

3 

8.8% 

7.0% 

1 

5.0% 

2.0% 

4 

5.1% 

3.1% 

Risk  Assessment  -  Strategic 

5 

14.7% 

11.6% 

0 

0.0% 

0.0% 

5 

6.3% 

3.9% 

Procedural  Guidance/Publications 

11 

32.4% 

25.6% 

6 

30.0% 

11.8% 

20 

25.3% 

15.7% 

Organizational  Training  Issues/Programs 

2 

5.9% 

4.7% 

4 

20.0% 

7.8% 

10 

12.7% 

7.9% 

Doctrine 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

1 

13% 

0.8% 

Program  Oversight/Management 

2 

5.9% 

4.7% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Unsafe  Supervision  ' 

.  13  7 

3*i% 

303% 

;-:*y 

40.6% 

is:?% 

7  266%  ' 

’  16.5% 

Inadequate  Supervision 

8 

23.5% 

18.6% 

5 

25.0% 

9.8% 

19 

24.1% 

15.0% 

Leadership/Supervision/Oversight  Inadequate 

2 

5.9% 

4.7% 

2 

10.0% 

3.9% 

5 

6.3% 

3.9% 

Local  Training  Issues/Programs 

6 

17.6% 

14.0% 

2 

10.0% 

3.9% 

8 

10.1% 

6.3% 

Supervision  -  Policy 

2 

5.9% 

4.7% 

1 

5.0% 

2.0% 

9 

11.4% 

7.1% 

Planned  Inappropriate  Opeations 

6 

17.6% 

14.0% 

3 

15.0% 

5.9% 

9 

11.4% 

7.1% 

Ordered/Led  on  Mission  Beyond  Capability 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

2 

2.5% 

1.6% 

Crew/Flight  Makeup/Composition 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

limited  Recent  Experience 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Limited  Total  Experience 

1 

2.9% 

2.3% 

2 

10.0% 

3.9% 

1 

1.3% 

0.8% 

Proficiency 

I 

2.9% 

2.3% 

1 

5.0% 

2.0% 

6 

7.6% 

4.7% 

Risk  Assessment  -  Deliberate 

2 

5.9% 

4.7% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Failed  to  Correct  Known  Problem 

2 

5.9%  ' 

4.7% 

0 

0.0% 

0.0% 

3 

3.8% 

2.4% 

Personnel  Management 

1 

2.9*/. 

2.3% 

0 

0.0% 

0.0% 

2 

2.5% 

1.6% 

Operations  Management 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Supervisory  Violations 

2 

5.9% 

4.7% 

2 

10.0% 

3.9% 

0 

0.0% 

0.0% 

Supervision  -  Discipline  Enforcement 

0 

0,0% 

0.0% 

2 

10.0% 

3.9% 

0 

0.0% 

0.0% 

Supervision  -  Defacto  Policy 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Authorized  Unnecessary  Hazard 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

.IjieoiiiioaiforUnialtAca  .. 

.  5M% 

46 j%;. 

Spiffs 

«5JD%  ■ 

iisjvf 

w&z 

45.6% 

283% 

Physical  Environment 

0 

6.0% 

6.6% 

i 

5.0% 

2.0% 

8 

10.1% 

6.3% 

Vision  Restricted  by  IcingAVindows  Fogged/Etc. 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Vision  Restricted  by  Weather/Haze/Darkness^Etc. 

0 

0.0% 

0.0% 

l 

5.0% 

2.0% 

6 

7.6% 

4.7% 

Lighting  of  Other  Aircraft/Vehicle 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Technological  Environment 

16 

47.1% 

37 2% 

2 

10.0% 

3.9% 

8 

10.1% 

6.3% 

Instrumentation  and  Sensory  Feedback  Systems 

9 

26.5% 

20.9% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Visibility  Restrictions 

0 

0.0% 

0,0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Controls  and  Switches 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

3 

3.8% 

2.4% 

Automation 

10 

29.4% 

23.3% 

1 

5.0% 

2.0% 

2 

2.5% 

1.6% 

Communications  -  Equipment 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

2 

2.5% 

1.6% 

*Factor  frequency  as  a  percentage  of  only  mishaps  caused  by  human  factors. 
fFactor  frequency  as  a  percentage  of  mishaps  of  all  causes. 
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Air  Force 

Army 

Navy/Marines 

Human-Factor 

Total 

Human-Factor 

Total 

Human-Factor 

Total 

Mishaps'* 

Mishaps! 

Mishaps* 

Mishaps! 

Mishaps* 

Mishaps! 

DoD  HFACS  categories  (v5.7) 

Mishaps 

(n=34) 

(n=43) 

Mishaps 

(n=20) 

(n=51) 

Mishaps 

(n=79) 

(n=127) 

Physical/Mental  Limitations 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Learning  Ability/Rate 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Motor  Skill s/Coordination  or  Timing  Deficiency 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Cognitive  Factors 

9 

26.5% 

20.9% 

3 

15.0% 

5.9% 

15 

19.0% 

11.8% 

Inattention 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

3 

3.8% 

2.4% 

Channelized  Attention 

5 

14.7% 

11.6% 

1 

5.0% 

2.0%  : 

7 

8.9% 

5.5% 

Cognitive  Task  Oversaturation 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

4 

5.1% 

3.1% 

Confusion 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

1 

1.3% 

0.8% 

Negative  Transfer 

1 

2.9% 

2.3 % 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Distraction 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

4 

5.1% 

3.1% 

Habit  Pattern  Interference 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Adverse  Physiological  States 

3 

8.8% 

7.0% 

0 

0.0% 

0.0% 

3 

3.8% 

2.4% 

Pre-Existing  Physical  Illness/Injury/Deficit 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Fatigue  -  Acute 

2 

5.9% 

4.7% 

0 

0.0% 

0.0% 

2 

2.5% 

1.6% 

Fatigue  -  Chronic 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Psycho-Behavioral  Factors 

4 

11.8% 

9.3% 

6 

30.0% 

11.8% 

11 

13.9% 

8.7% 

Pre-Existing  Personality  Disorder 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Pre-Existing  Psychological  Disorder 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Emotional  State 

0 

0.0% 

0.0% 

1 

5.0% 

2.0% 

0 

0.0% 

0.0% 

Overconfidence 

0 

0.0% 

0.0 % 

5 

25.0% 

9.8% 

1 

1.3% 

0.8% 

Pressing 

2 

5.9% 

4.7% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Complacency 

2 

5.9% 

4.7% 

0 

0.0% 

0.0% 

9 

11.4% 

7.1% 

Perceptual  Factors 

3 

8.8% 

7.0% 

2 

10.0% 

3.9% 

6 

7.6% 

4.7% 

Illusion  -  Visual 

0 

0.0% 

0.0% 

2 

10.0% 

3.9% 

0 

0.0% 

0.0% 

Misperception  of  Flight  Conditions 

3 

8.8% 

7.0% 

0 

0.0% 

0.0% 

5 

6.3% 

3.9% 

Spatial  Disorientation  -  Recognized  (Type  2) 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

1 

1.3% 

0.8% 

Crew  Resource  Management 

6 

17.6% 

14.0% 

7 

35.0% 

13.7% 

25 

31.6% 

19.7% 

Crew  Coordination/Flight  Integrity 

4 

11.8% 

9.3% 

4 

20.0% 

7.8% 

6 

7.6% 

4.7% 

Communication 

1 

2.9% 

2.3% 

2 

10.0% 

3.9% 

9 

11.4% 

7.1% 

Mission  Preparation 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

6 

7.6% 

4.7% 

Analysis 

i 

2.9% 

2.3% 

1 

5.0% 

2.0% 

5 

6.3% 

3.9% 

Crew  Leadership 

0 

0.0% 

0.0% 

i 

5.0% 

2.0% 

4 

5.1% 

3.1% 

Authority  Gradient 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

3 

3.8% 

2.4% 

. V  •  . . 
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"  70.6% 

55  8%  "" 

16 

80.0% 

31.4% 

'  ‘  44  '' ' 

.  55.7%  " 

34.6% 

Skill-Based  Errors 

17 

50.0% 

39.5% 

6 

30.0% 

11.8% 

21 

26.6% 

16.5% 

Inadvertent  Operation  -  Mechanically  Induced 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

1 

1.3% 

0.8% 

Checklist  Error 

3 

8.8% 

7.0% 

1 

5.0% 

2.0% 

1 

1.3% 

0.8% 

Navigational  Error 

1 

2.9% 

2.3% 

0 

0.0% 

0.0% 

0 

0.0% 

0.0% 

Procedural  Error 

14 

41.2% 

32.6% 

1 

5.0% 

2.0% 

10 

12.7% 

7.9% 

OvercontrolAJndercontrol 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

7 

8.9% 

5.5% 

Breakdown  in  Visual  Scan 

2 

5.9% 

4.7% 

3 

15.0% 

5.9% 

6 

7.6% 

4.7% 

Judgment  &  Decision-Making  Enors 

13 

38.2% 

30.2% 

9 

45.0% 

17.6% 

30 

38.0% 

23.6% 

Risk  Assessment  -  Time  Critical 

9 

26.5% 

20.9% 

4 

20.0% 

7.8% 

21 

26.6% 

16.5% 

Task  Misprioridzation 

2 

5.9% 

4.7% 

1 

5.0% 

2.0% 

9 

11.4% 

7.1% 

Necessary  Action  -  Rushed 

0 

0.0% 

0.0% 

1 

5.0% 

2.0% 

0 

0.0% 

0.0% 

Necessary  Action  -  Delayed 

5 

14.7% 

11.6% 

2 

10.0% 

3.9% 

4 

5.1% 

3.1% 

Caution/Waming  Ignored 

1 

2.9% 

2.3% 

1 

5.0% 

2.0% 

1 

1.3% 

0.8% 

Misperception  Errors 

3 

8.8% 

7.0% 

2 

10.0% 

3.9% 

6 

7.6% 

4.7% 

Violations 

3 

8.8% 

7.0% 

9 

45.0% 

17.6% 

6 

7.6% 

4.7% 

*Factor  frequency  as  a  percentage  of  only  mishaps  caused  by  human  factors. 
tFactor  frequency  as  a  percentage  of  mishaps  of  all  causes. 
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